Simulation software 



Cross Reference to Related Applications 

This application claims the benefit of U.S. Provisional Application No. 
60/337,949, filed Dec. 7, 2001, which is hereby incorporated herein by 
reference in its entirety. 

Background of Invention 

[0001] The invention relates to a simulation software and more 
particularly to a simulation software which displays human beings on monitors, 
LCDs, screens, and other display means in a realistic fashion. 

[0002] tB4:ety-sj^ is being used in video 

games, military training devices, and other types of devices which implement 
virtual reality. These devices are designed to display various types of objects 
which exist in the real world, however, the users thereof perceive a sense of 
awkwardness to the movement of a human being displayed thereon gives a 
S€H^se-ef-aw4<-wa these devices do not reflect 

the movement of a human being in the real world in a precise manner. One 
reason whieh--^¥es--su€^--se^se-ef--a^wk¥^afd-Ress for such awkwardness is that 
the clothe clothes worn by a human being does not do not wrinkle at all when 
he/she bends his/her limbs. Fig. 1a and Fig. 1b illustrate the method of 
displaying an arm of a human being by utilizing the prior art. As described in 
Fig. 1 a, arm AR of a human being is composed of hand HD, lower arm LA, 
joint JT, and upper arm UA. Assuming that arm UA is covered by fabric FB, 
i.e., the human being is wearing a clothe the clothes which covers cover 
his/her arms. When arm AR is stretched as described in Fig. 1a and joint JT is 
not bent, wrinkle does not occur on or near joint JT. When arm AR is bent as 
described in Fig. 1b, hewever T -due to the nature of fabric FB ef^-ef-mepe-ef 
wmk ie s - one or more wrinkles occur on or near joint JT in the real world. Fr i er 
af - t -- h - as -- net --- v - e t-- de&Grteed - The prior art does not describe the movement of 
limbs in such a way thereby gives a s en s e of aw k w ardne ss to the u s ers since 
no wrin k l es a r e s ho w n, and because no wrinkles are shown, the users 
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perceive a sense of awkwardness. Anetiw -- f e asen --w h i €^ 



described in Fig. 1 b, the muscles of upper arm UA bulge in the real world, 



way. 



[0003] U.S. Pat. No. 6,317,125 introduces a video object generation 
method (100) for converting a model (102) such that a tessellation operation 
(164) can create a realistic character in real time during game play. According 
to this prior art, a shelling and slicing operation (106) produces data strings 
(140) describing a plurality of slices (110) of the model (102). An assign body 
parts and edit strings operation (130) places cuts (134) on the model (102) 
and an apply influences operation (144) establishes the influence on each of a 
plurality of points (142) from a plurality of bones (148) of a skeleton (146). In 
real time operations (162) a tessellation operation (164) creates a triangle 
mesh (165) appropriate to the position and importance of the character in 
game space, and a properly bent character is displayed in a display operation 
(168). This prior art introduces the concept of producing realistic images, 
however, does not explain nor imply the present invention, i.e., the method of 
producing and displaying wrinkles on limbs of a human being. 



[0004] U.S. Pat. No. 6,317,130 introduces apparatus and method to 
enable an animation character object, which is pictorially deformed by 
computer graphics techniques to v i sua ll v - re0resen - t - h - uma - R -- be€!v -- disDSav a 
human body or animal or the like in the form of a caricature or model, to offer 
precise and more natural motions at its selected constituent portions that have 
inherently no joints and no bones by giving thereto joints and skeletons. 
According to this prior art, apparatus and method for generating skeleton- 
based animation images in accordance with the principles of the invention 
include solving means as follows. A face section of a cubic character object is 
provided with auxiliary skeletons as vertically coupled together. Skeletons are 
provided which extend from respective endpoints of such auxiliary skeletons 
and are coupled defining an umbrella shape as a whole. These skeletons are 
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associated with models each consisting of an ensemble of polygons for 
rendering the character deformable by changing rotation amount of each 
skeleton. This prior art introduces the concept of producing realistic images, 
however, does not explain nor imply the present invention, i.e., the method of 
producing and displaying wrinkles on limbs of a human being. 

[0005] U.S. Pat. No. 6,310,619 introduces a three-dimensional, virtual 
reality, tissue specific model of a human or animal body which provides a high 
level of user-interactivity. According to this prior art, the model functions can 
be analyzed and user-modified on a tissue-by-tissue basis, thereby allowing 
modeling of a wide variety of normal and abnormal tissue attributes and 
corresponding study thereof. The model can be user-modified through a 
keyboard, or other VR tools such as a haptic interface. The haptic interface 
can modify the model to correspond to the tissue attributes of a user, and can 
provide sensory output corresponding to the interaction of the model to a 
prescripted scene. A three-dimensional, virtual reality, tissue specific model of 
a human or animal body which provides a high level of user-interactivity. The 
model functions can be analyzed and user-modified on a tissue-by-tissue 
basis, thereby allowing modeling of a wide variety of normal and abnormal 
tissue attributes and corresponding study thereof. The model can be user- 
modified through a keyboard, or other VR tools such as a haptic interface. The 
haptic interface can modify the model to correspond to the tissue attributes of 
a user, and can provide sensory output corresponding to the interaction of the 
model to a prescripted scene. This prior art introduces the concept of 
producing realistic images, however, does not explain nor imply the present 
invention, i.e., the method of producing and displaying wrinkles on limbs of a 
human being. 

[0006] U.S. Pat. No. 5,625,577 introduces a motion analyzing method 
which analyzes and displays motions of a human being or an animal using a 
computer in an interactive manner without requiring trial and error or without 
depending on intuition of an analyst. According to this prior art, a human body 
or an animal body is divided into a plurality of segments connected by joints, 
each of the segments acting as a minimal unit of motion. Data for modeling 
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the human or animal body on the basis of physical constraints and the 
inherent nature of each of the segments is maintained in a database. Motions 
are input to be analyzed and the input motions are analyzed using inverse 
dynamics. The resultant movements and the center of gravity of each of the 
segments, the force and torque exerted on each of the joints, the movement 
and the center of gravity of the whole body, and the forces and torques 
exerted on the centers of gravity are superimposed on the human or animal 
body model of the database and are displayed on a screen. The new motions 
thus displayed can be used for the teaching of new skills in the industrial or 
performing arts, in sports, or in animal training. This prior art introduces the 
concept of producing realistic images, however, does not explain nor imply the 
present invention, i.e., the method of producing and displaying wrinkles on 
limbs of a human being. 

[0007] U.S. Pat. No. 6,215,500 introduces methods and systems for 
compressing and decompressing 3-D geometry data which includes regularly 
tiled surface portions. According to this prior art, one compression method 
includes representing a surface portion as a "vertex raster", which comprises 
specifying an extent value and encoding the vertex parameter values of 
vertices within the surface portion. The extent of the surface portion specifies 
the arrangement of vertices within the surface portion, and allows the vertices 
to be properly assembled into drawing primitives during decompression. The 
encoded vertex parameter values may be encoded globally (by setting initial 
values and corresponding delta values), locally (on a per-vertex basis), or 
using a combination of these techniques. Absolute, delta encoding, or delta- 
delta encoding may be utilized for these parameter values. Vertex parameters 
which may be encoded in this manner include position, color, normals, z- 
displacement values, texture map coordinates, and surface material 
properties. Additionally, connectivity information may also be encoded using 
this compression method by specifying quad split bits and half-resolution 
edges. Quad split bits are used to tessellate a quadrilateral formed by 
neighboring vertices of a surface portion according to the direction of the 
strongest color change. Half-resolution edges are utilized to gradually shift 
from an area of high resolution to an adjacent surface portion represented in 
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lower resolution. For graphical objects which include a plurality of adjacent 
surface portions, a step command is disclosed which allows data from one 
surface portion to be advantageously reused. Decompression of a vertex 
raster representation may comprise decoding the extent value, global 
parameter values, and a per-vertex stream of local parameter values. This 
prior art introduces the concept of producing realistic images, however, does 
not explain nor imply the present invention, i.e., the method of producing and 
displaying wrinkles on limbs of a human being. 

[0008] U.S. Pat. No. 6,204,860 introduces a system that defines a wire 
curve deformation primitive with a free-form parametric curve associated with 
the closest points to the curve on a surface of a model. According to this prior 
art, the wire curve includes a radius influence defining the points on the object 
which will be deformed. A scale factor determines the amplitude of the scaling 
or point movement that is caused by the wire curve. A blending function of the 
wire curve defines t - he -- tfaRS -[ t -E en -- fe^ 

und e- ferm e 4 -- r e g4^ the transition from the deformed regions to 

the undeformed regions of the object. The wire curve can have associated 
with it holder curves defining the domain of deformation about an object 
caused by one or more wires. A holder curve holds the points of the object in 
place. Locators are used to define different parameters values along the wire 
curve. Changes in parameter values around the locators are accomplished by 
interpolation. Deforming includes preprocessing steps as well as deformation 
stage operations. This prior art introduces the concept of producing realistic 
images, however, does not explain nor imply the present invention, i.e., the 
method of producing and displaying wrinkles on limbs of a human being. 

[0009] U.S. Pat. No. 6,144,385 introduces a character animation system 
executing on a computer. According to this prior art, the system provides a 
simple, efficient and powerful user interface that allows the user to specify 
complex animations of multi-legged characters by placing footprints on a 
surface. A compiler automatically generates a natural looking animation based 
on the footprints. Motions such as walking, running, jumping, etc. are easily 
animated depending on the way footprints are placed. The user is able to 
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create new footprint patterns and modify existing patterns. Footprint blocks on 
a timeline are used to specify the time duration that each foot is in contact with 
a footprint. The user may specify keyframes in the animation sequence that 
allow more complicated body movements to be incorporated with the footprint 
based animation. This prior art introduces the concept of producing realistic 
images, however, does not explain nor imply the present invention, i.e., the 
method of producing and displaying wrinkles on limbs of a human being. 

[0010] U.S. Pat. No. 6,088,034 introduces a method and apparatus 
wherein three-dimensional compressed geometry is decompressed with a unit 
having an input FIFO receiving compressed data bits and outputting to an 
input block state machine and an input block, whose outputs are coupled to a 
barrel shifter unit. According to this prior art, input block output also is input to 
Huffman tables that output to the state machine. The state machine output 
also is coupled to a data path controller whose output is coupled to a tag 
decoder, and to a normal processor receiving output from the barrel shifter 
unit. The decompressor unit also includes a position/color processor that 
receives output from the barrel shifter unit. Outputs from the normal processor 
and position/color processor are multiplexed to a format converter. For 
instructions in the data stream that generate output to the format converter, 
the decompression unit generates a tag sent to the tag decoder in parallel 
with bits for normals that are sent to the format converter. The decompressed 
stream of triangle data may then be passed to a traditional rendering pipeline, 
where it can be processed in full floating point accuracy, and thereafter 
displayed or otherwise used. This prior art introduces the concept of 
producing realistic images, however, does not explain nor imply the present 
invention, i.e., the method of producing and displaying wrinkles on limbs of a 
human being. 

[0011] U.S. Pat. No. 6,064,390 introduces an apparatus and method for 
representing expression in a tissue-like system that may include a human face, 
where the system is particularized to a specified individual. According to this 
prior art, a graphical representation generator implemented in a computer 
determines a representation, in terms of a finite-element model, of the surface 
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of the tissue of the system, providing a graphic output defining the surface in 
world coordinates. An expressive detail generator, including a wrinkle 
generator, modifies the surface determined by the graphical representation 
generator before the surface has been mapped into world coordinates in 
accordance with three-dimensional features of the tissue-like system of a 
particular subject. This prior art introduces the concept of producing realistic 
images, however, does not explain nor imply the present invention, i.e., the 
method of producing and displaying wrinkles on limbs of a human being. 

[0012] U.S. Pat. No. 5,850,222 introduces a computer system for 
displaying clothing on a rendered image of a human body referred to as a 
virtual dressing room system ("VDRS"). According to this prior art, the VDRS 
receives a series of contour lines defining the three-dimensional shape of the 
human body. A contour line is a series of points that defines the perimeter of 
the body in a horizontal plane. The VDRS also receives a sequence of points 
defining the two-dimensional shape of the clothing. The VDRS also scales the 
sequence of points defining the two-dimensional shape of the clothing to the 
approximate width of a portion of the human body over which the clothing is 
worn. For each point of the two-dimensional shape, the VDRS identifies a 
corresponding point on a contour line, and adjusts the point of the two- 
dimensional shape of the clothing to correspond to the identified point. The 
VDRS renders the shape of the human body on a display device, and lenders 
the scaled and adjusted two-dimensional shape of the clothing on the display 
device to effect the display of the human body wearing the clothing. This prior 
art introduces the concept of producing realistic images, however, does not 
explain nor imply the present invention, i.e., the method of producing and 
displaying wrinkles on limbs of a human being. 

[0013] U.S. Pat. No. 5,802,220 introduces a system which tracks human 
head and facial features over time by analyzing a sequence of images. 
According to this prior art, the system provides descriptions of motion of both 
head and facial features between two image frames. These descriptions of 
motion are further analyzed by the system to recognize facial movement and 
expression. The system analyzes motion between two images using 
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parameterized models of image motion. Initially, a first image in a sequence of 
images is segmented into a face region and a plurality of facial feature regions, 
A planar model is used to recover motion parameters that estimate motion 
between the segmented face region in the first image and a second image in 
the sequence of images. The second image is warped or shifted back towards 
the first image using the estimated motion parameters of the planar model, in 
order to model the facial features relative to the first image. An affine model 
and an affine model with curvature are used to recover motion parameters 
that estimate the image motion between the segmented facial feature regions 
and the warped second image. The recovered motion parameters of the facial 
feature regions represent the relative motions of the facial features between 
the first image and the warped image. The face region in the second image is 
tracked using the recovered motion parameters of the face region. The facial 
feature regions in the second image are tracked using both the recovered 
motion parameters for the face region and the motion parameters for the facial 
feature regions. The parameters describing the motion of the face and facial 
features are filtered to derive mid-level predicates that define facial gestures 
occurring between the two images. These mid-level predicates are evaluated 
over time to determine facial expression and gestures occurring in the image 
sequence. This prior art introduces the concept of producing realistic images, 
however, does not explain nor imply the present invention, i.e., the method of 
producing and displaying wrinkles on limbs of a human being. 

[0014] U.S. Pat. No. 5,687,737 introduces an optimal electrophysiologic 
mapping system for map-directed arrhythmia surgery and cardiac research 
allows rapid and accurate interpretation of cardiac activation sequences. 
According to this prior art, the system can display activation or potential 
distribution data on an anatomically accurate 3-D model of the heart and 
allows fast, interactive control of viewing characteristics, including control of 
which cardiac surfaces are displayed, control of virtual lighting, rotational 
control of the displayed image, etc. The system employs two computer 
programs, GETPIC3 and MAP3, and runs on a Silicon Graphics workstation 
capable of rapid graphics calculations and displays. The system utilizes 3-D 
models of epicardial and endocardial surfaces created with the GETPIC3 
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program from a sequence of 2-D images of a heart. The individual surfaces 
are triangulated and may be smoothed using a spline function. The MAP3 
program displays activation times either as static isochronous maps or as 
dynamic time-since-last-activation maps. In the latter case, surface color 
denotes the time elapsed since a particular area activated. Potential 
distribution data may also be displayed dynamically. A mouse allows the 
system operator to control real-time rotation of the model in three dimensions, 
and any surface can be hidden interactively for better viewing of the data. 
Control is also provided over the starting, stopping, reversing, and repeating 
of data, as well as over the frame rate for dynamic displays. This prior art 
introduces the concept of producing realistic images, however, does not 
explain nor imply the present invention, i.e., the method of producing and 
displaying wrinkles on limbs of a human being. 

[0015] U.S. Pat. No. 5,504,845 introduces a three dimensional image of a 
solid form which is presented to an operator by means of a stereoscopic 
display. According to this prior art, the operator defines a panel on the surface 
of the form with a set of bounding seam lines. A polygonal mesh is generated 
between the seam lines and is manipulated in three dimensions by the 
operator to achieve a desired surface appearance, including wrinkles, folds, 
pleats and other details. Manipulation of the mesh is constrained by the 
mechanical properties of the surface material or fabric being modelled. 
Surface texture and shading are then mapped onto the mesh to fully render 
the surface appearance in three dimensions. This prior art introduces the 
concept of producing realistic images, however, does not explain nor imply the 
present invention, i.e., the method of producing and displaying wrinkles on 
limbs of a human being. 

[0016] U.S. Pat. No. 5,267,154 introduces a biological image formation 
aiding system and a biological image forming method which are provided in 
which three-dimensional data corresponding to a standard shape of a 
biological article, standard motion thereof, and a standard material feeling of 
an outer surface of the biological article are prepared, and a realistic three- 
dimensional synthesized image of an entire biological article with individuality 
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can be formed simply. According to this prior art, the system includes a shape 
data storage for storing data corresponding to a three-dimensional shape of a 
biological image; a motion data storage for storing data corresponding to 
three-dimensional motion of the biological image, a material feeling data 
storage for storing data corresponding to a three-dimensional material feeling 
of an outer surface of the biological image; editing/processing units capable of 
modifying at least one of the data corresponding to the three-dimensional 
shape of the biological image, the three-dimensional data corresponding to 
the motion of the biological image, and the data corresponding to the three- 
dimensional material feeling of the outer surface of the biological image in 
accordance with a producer's intent; and an output unit responsive to the 
outputs of the editing/processing unit for synthesizing the data corresponding 
to the three-dimensional biological image, the data corresponding to the three- 
dimensional motion of the biological image, and the data corresponding to the 
three-dimensional material feeling of the outer surface of the biological image 
after modification with each other to provide synthesized three-dimensional 
data for a biological image to be produced. This prior art introduces the 
concept of producing realistic images, however, does not explain nor imply the 
present invention, i.e., the method of producing and displaying wrinkles on 
limbs of a human being. 

[0017] U.S. Pat. No. 6,326,967 introduces an image creating apparatus 
which displays a plurality of identical game-element images in predetermined 
colors on an image display unit by pasting textures on polygons provided in a 
virtual three-dimensional space. According to this prior art, the image creating 
apparatus includes a polygon-data storage unit for storing the coordinates of 
N (integer not less than 2) sets of polygons constituting the element images 
so that N game elements are arranged and displayed on the display unit; a 
texture-selection-data storage unit for selecting one set of the textures which 
corresponds to one of the characters; a color-data storage unit for storing, as 
a basic color, a first color determined for the one set of the textures; a color- 
data setting unit for setting a second color; and a composite-color setting unit 
for setting composite colors for the textures to be pasted on N sets of 
polygons, the composite colors being obtained by mixing the first color and 
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the second color at different ratios. This prior art introduces the concept of 
producing realistic images, however, does not explain nor imply the present 
invention, i.e., the method of producing and displaying wrinkles on limbs of a 
human being. 

[0018] U.S. Pat. No. 6,322,448 introduces a image processing device for 
games which is a device whereby a prescribed number of models (characters) 
are set up in virtual space, these models are controlled such that they move in 
prescribed directions in the virtual space, and images of this virtual space 
from a virtual viewpoint are displayed on means for display. According to this 
prior art, in order to display the movement of the models that are arranged in 
virtual space more realistically, in one construction thereof, this device is 
provided with means for image processing that apply virtual centripetal force 
to the models. Furthermore, in order to display the movement of the models 
more realistically and to heighten the dramatic effect, in one construction 
thereof, this device is equipped with means for processing residual image 
presentation in order to represent the track of movement of a model as 
residual images. This means for processing is equipped with means for 
storage that store without modification motion data of the model prior to the 
current motion and with means for display control that display this stored data 
together with the current motion data. This prior art introduces the concept of 
producing realistic images, however, does not explain nor imply the present 
invention, i.e., the method of producing and displaying wrinkles on limbs of a 
human being. 

[0019] U.S. Pat. No. 6,320,988 introduces a method of transforming the 
shape of a skeleton model, wherein this method can easily handle a skeleton 
model of a multiple-branching structure and enables the easy setting of 
complicated restrictive conditions. According to this prior art, node coordinates 
and arc-normal vectors are used as basic variables. Basic equations, which 
comprise an equation defining the length of an arc and which use basic 
variables as unknowns, and an evaluation expression for uniquely specifying 
a solution that satisfies these basic equations are modified, based on data 
such as mouse input. A solution for the basic variables that satisfies the basic 
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equations and minimizes the value of the evaluation expression is obtained, 
and the shape of the skeleton model is transformed accordingly. The 
evaluation expression is used to set minimization of the sum-of-squares of 
arc-to-arc angles, rubber-banding, dampers, and inertia. The basic equations 
and the evaluation expression are updated in synchronization with the end of 
a loop. A spring restriction can be set, and the use of a restrictive condition in 
the next loop of the calculations can be determined from whether or not the 
restrictive condition was used in the previous loop, and whether or not an 
object has passed a boundary. This prior art introduces the concept of 
producing realistic images, however, does not explain nor imply the present 
invention, i.e., the method of producing and displaying wrinkles on limbs of a 
human being. 

Summary of Invention 

[0020] It is an object of the present invention to provide a method of 
producing and displaying wrinkles on limbs of a human being. 

[0021] Still another object is to overcome the aforementioned 
shortcomings associated with the prior art. 

[0022] Further objects, features, and advantages of the present invention 
over the prior art will become apparent from the detailed description which 
follows, when considered with the attached figures. 

[0023] T - he -- pfesefrt --i n - ven - t^ 
d i- &p j- ay i ng - a -- hBmaB - ^ 

of limbs comprises a first part and a second part and is also capable of 



second part wherein said first part and said second part is connected, the 



mer e- th e- va l u e- of - sa^ 
he i gfo - t -- of -- sa -i d --w m 



sa id se cond p a rt in a r ea li s tic m a nn e r. 
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The present Invention introduces a wrinkie simulation software for displaying a 
human being comprised of a plurality of arm pints, wherein each of the 
plurality of arm joints comprises a 1 st part and a 2nd part. The invention also 
displays one or more wrinkles on or near the joint of the 1 st part and the 2nd 

produced by_.the.1 st part and 2nd p art is varLable^ 
angle decreases, the more the amount and/or the height of the wrinkle 
increases, thereby enabling the wrinkle simulation software to display the 
movement of the human being and the movement of the 1st and the 2nd part 
in a realistic manner. 

[0024] T-he-present invention f u rt h er-ifrtrod u ces a SrEfflutat-iere software 
capable of displaying a human being comprising of a plurality of limbs and 



s a -i d --- fi - r - st -- pa^ 
f i rst -- paf - t -- a - Rd -- s - a^ 

ang le- d e G - r e es e s -- th e-- mef e-- t^ e 4h 4 ek^ e s - Sr - ef sa i d - firs t- part - i ncf e a - ses - th e r e by 
ef*abUnQ-- s aid -simul-atien-s e ftw a r e to display the mov e ment -of- s a id hum a n 



manner. 

The present invention further introduces a muscle movement simulation 
software for displaying a human being comprised of a plurality of arm joints, 
wherein each of the plurality of arm joints comprises a 1st part and a 2nd part 
The 1st part and the 2nd part are connected, and the angle produced by the 
1st part and 2nd part is variable. The more the value of the angle decreases, 
the more the thickness of the 1st part increases, thereby enabling the muscle 
movement simulation software to display the movement of the human being 
and the ^ 

Brief Description of Drawings 

[0025] The above and other aspects, features, and advantages of the 
invention will be better understood by reading the following more particular 
description of the invention, presented in conjunction with the following 
drawings, wherein: 
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[0026] F -i €h --- 1 - a --i- s - a -- s a fn^ 1a and 1b are simplified 

illustrations illustrating the met&e4- methods to display the arm of a human 
being by utilizing the prior art. 

[0027] Fig. 1b is a simplified illustration illustrating the method to display 
tfee -- af - m - ef - a - ^ 

[0028] Fig. 2 is a block diagram illustration of the computer which 
performs the present invention. 

[0029] Fig. 3 is a simplified illustration of the area included in the RAM. 

[0030] Fig. 4 is a simplified illustration illustrating the concept of the 
present invention. 

[0031] Fig. 5 is a simplified illustration illustrating one method of 
generating wrinkles. 

[0032] Fig. 6 is a simplified illustration illustrating another method of 
generating wrinkles. 

[0033] Fig. 7 is a simplified illustration of the area included in the RAM. 

[0034] Fig. 8 is a simplified illustration of the content included in the RAM 
illustrated in Fig. 7. 

[0035] Rqt 9a i s a s implifi e d iHustfatieR -Fias. 9a through 9e are simplified 
illustrations of the method methods to display the arm on the monitor. 

[0036] F-i g - . -- Qb - 4S -- a -- s i f^ 
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[0037] F i g - : -- 9e4s -- a -- s i mp l- ffi 
en4he - rROB f tef - : 



[0038] Fig. 9e is a simplified illustration of the method to displa y the arm 



[0039] Fig. 10 is a simplified illustration of the area included in the RAM. 



[0040] Fig. 11 is a flowchart illustrating the operation of the wrinkle 
generating software. 



[004 1 ] F4^ r 4-2e4s--^ 12a through 12d are 

simplified illustrations of an exemplary embodiment exemplary embodiments 
to produce wrinkles. 



[0042] F -i §v - 42fe --i s -- a -- s i mpti - f^ 
predu€ -e-- wf 4 n - k -ie s - . 

produce wrinkles. 

[0044] Fig. 1 2d is a simplified illustration of an exemplary embodiment to 
produc e w rin k l es . 



[0045] Fig. 13 is a simplified illustration of the area included in the RAM. 



[0046] Fig. 14 is a simplified illustration of the content included in the 
RAM illustrated in Fig. 13. 



[0047] F4ar4-5a4s--a-^ 15a through 15e are 

simplified illustrations of the m et hod - methods to display a wrinkle on the 
monitor. 
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[0048] F i g - : --- 1 -- §b4s - a -- s i m^ 
wFi^kte - <=H^ -- the -- fTioB f teFv 

[0049] Fig. 15c is a simpli f ied illustration of t he method to dispiay a 



[0050] F -i g - -1 - 54 --f s -- a -- S 4 mpti 
wrinkle on the mo n itor. 

[0051] Fig. 15o is a s implified--iif u st-ratk^^ 
wrinkle on the monitor. 

[0052] Fig. 16 is a simplified illustration of the area included in the RAM. 



[0053] Fig. 17 is a flowchart illustrating the operation of the wrinkle 
generating software. 

[0054] Fia-:-1-8a--js a simplified illustration Figs. 18a through 18e are 
simplified the methe4-mM!l2ds„to display the arm on the 

monitor. 



[0055] Fig. 18b is a simplified illustration of the method to display the arm 
on th e monitor. 

[0056] F -i g - . -- 48€ --i s -- a -- s i f^ 

en-th e -mef^ i tor" ' 

on the monitor. 

[0058] F -j § - . --- 1 - 8 e- 4S -- a -- s i mpti - fi 
en -- t&e -- men i ter - . - 



[0059] Fig. 19 is a simplified illustration of the area included in the RAM. 
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[0060] Fig. 20 is a simplified illustration of the content included in the 
RAM illustrated in Fig. 20. 



[0061] ftQ-:--24-a--^^ 21a through 21 e are 

simjajjf^ the method methods to display the arm on the 

monitor. 



[0062] 

OR-t-he-monttoFv 



[0063] H§r 

on the monitor. 



[0064] F \ § - : -- 2144sQ -- & 
[0065] Fig-:--2-1-e--fs-a--£im^ 



[0066] Fig. 22 is a simplified illustration of the area included in the RAM. 



[0067] Fig. 23 is a flowchart illustrating the operation of the wrinkle 
generating software. 



[0068] F -i 9: -- 24a - 4S"a - s f mp ^i f ie d - 4 ll ustFat4Qn -- Figs. 24a through 24e are 
simplified illustrations of the method methods to display the arm on the 
monitor. 



[0069] 

en4h e-- moB i tef - : 



[0070] Fig. 24 c is a si m pli f ied illustration of the method to displ a y w rinkle s 
on -t h - e - mef fit of" 
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[0071] F -i §v -- 2 -4 4 --i s -- a -- s i ^ 



[0072] 

on the monitor. 

[0073] Fig. 25 is a simplified illustration of the area included in the RAM. 

[0074] Fig. 26 is a simplified illustration of the method to display the arm 
on the monitor. 

[0075] Fig. 27 is a simplified illustration of the method to display muscle 
movement. 

[0076] Fig. 28 is a simplified illustration of the area included in the RAM. 

[0077] Fig. 29 is a simplified illustration of the data stored in the RAM. 

[0078] Fig. 3Qa is a simplified illustration Figs JjQ^ 

simplified illustrations of the method- methods to display the arm on the 

monitor. 

[0079] Fig. 30b i s a s implified illu s tration of the metho d to display the arm 
en-the - fflea i tQ - r - : 

[0080] Fig. 30c is a simplified illustration of the method to display the arm 



[0081] 

en - th e- moB i ter - : 

[0082] Fig. 30e i s a s impli f ied illu s t r ation of t h e metho d to displ a y the arm 
on -t h - e - mof fit of- 
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[0083] Fig. 31 is a flowchart illustration of illustrating the operation of the 
muscle movement generating software. 



[0084] ftav--32-a^^ 32a through 32e are 

sjmjaj^^ the method methods to display the muscle movement 

on the monitor. 

[0085] Fig. 32b i s a s imp l ifi e d illu s tr a tion of th e me thod to di s pl a y th e 
mu-s e -[e-ffKwei^n£ 

[0086] F4^ r -.g2€4s-«-^^ 
muscle movement on the monitor. 

[0087] Fig - : -- 3 - 2 - d4s - a -- s i m^ 
musd - e -- mov - emeR t-- eR ^ 

[0088] Fig-:--3-2-e4s-e--siffl^ 
Detailed Description 

[0089] The following description is of the best presently contemplated 
mode of carrying out the present invention. This description is not to be taken 
in a limiting sense but is made merely for the purpose of describing the 
general principles of the invention. The scope of the invention should be 
determined by referencing the appended claims. 

[0090] FIG. 2 illustrates the details of computer 200 which performs the 
present invention. CPU 21 1 controls and administers the overall function and 
operation of computer 200. CPU 21 1 uses RAM 206 to temporarily store data 
and/or to perform calculation to perform its function. Video generator 202 
generates af^teg^jialc^ue and/or digital video signals which are displayed on 
monitor 201 . Sound generator 205 generates aBa!e§^naiSlSyB and/or digital 
"^^ee-aL^^signals which are transferred to speaker 204. HDD 207 stores 
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data and/or programs which are necessary to perform the present invention. 
Interface 208 is an interface between computer 200 and a server which 
enables computer 200 to send and receive digital data with the server. Input 
signals are input by input device 210, such as keyboard and joystick, and the 
signals are transferred via input interface 209 and data bus 203 to CPU 21 1 . 
Computer 200 can have the same or a similar sjmj iLa r structure to the 
computers which are described in FIG. 1 of the-U.S. Pat. No. 5,870.101, FIG. 
2 of me- U.S. Pat. No. 6,157,384, FIG. 1 of the-U.S. Pat. No. 5,774,125, FIG. 1 
of the-U.S. Pat. No. 5,375,206, and/or FIG. 1 of the-U.S. Pat. No. 5,925,127. 
Overall, computer 200 has the capability of displaying three-dimensional 
objects on monitor 201 by utilizing the texture mapping method or only by 
eei¥€HHK->s polygon method . Video Generator 202 t-akes--th-e-ffla}ef- rol e in is 
used for displaying the three-dimensional objects. 



[0091] As illustrated in Fig. 3, RAM 206 (Fig. 2) includes area 301 . Area 
301 stores a wrinkle generating software which is designated to generate 
wrinkles as described in details hereinafter. 



[0092] Fig. 4 illustrates the concept of the present invention. As described 
in Fig. 4, arm AR of an object (human be i nq a jTuma n being ) consists of hand 
HD, lower arm LA, joint JT, and upper arm UA. Assuming that arm UA is 
covered by fabric FB, i.e., the object is wearing a suit of clothes which covers 
his/her arms. When arm AR is bent, wrinkles 400 is generated on or near joint 
JT by the wrinkle generating software stored in area 301 (Fig. 3) of RAM 206 
(Fig.2). 



[0093] Fig. 5 illustrates the method of generating wrinkles. The most 
convenient way to generate wrinkles is to paste a texture describing wrinkles 
on a piece of polygon by the method so-called the "texture mapping." The 
details of such method are explained in the patents described hereinbefore. 
The method of "texture mapping" is not explained in this patent specification in 
details since such method itself is not the object of the present invention. As 
illustrated in Fig. 5, texture 501 which is applied on or near joint JT (Fig. 4) 
has a pattern consisting of a plurality of plateaus and valleys. Plateaus 502, 
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519, and 505 represent the highest portion of the wrinkles displayed and 
valley 503 and 504 represent the space between the wrinkles. For purposes 
of designing texture 501, plateaus 502, 519, and 505 are displayed with lighter 
colors, and valley 503 and 504 are displayed with darker colors compared to 
these plateaus. 



[0094] Fig. 6 illustrates another method of generating wrinkles. A plurality 
of polygons in this embodiment are used to generate wrinkles. Nam el y 
pol y gon s Namely, polygons P1 and P2, P3 and P4, and P5 and P6 represent 
wf4n-k4e- a wrinkle respectively. Mefe--pfeeteej-y--ti>e-- jVlore precisely, the 
connected portion of polygons P1 and P2 represents plateau 502, the 
connected portion of polygons P2 and P3 represents valley 503, the 
connected portion of polygons P3 and P4 represents plateau 519, the 
connected portion of polygons P4 and P5 represents valley 504, and the 
connected portion of polygons P5 and P6 represents plateau 505 in Fig. 5. 

[0095] Fig. 7 through Fig. 12d illustrate the method of determining the 
amount of wrinkles that should be displayed on monitor 201 (Fig. 2). 



[0096] As illustrated in Fig. 7, RAM 206 (Fig. 2) includes area 302. Area 
302 stores a plurality of data which are necessary to produce a plurality of 
wrinkles. 



[0097] Fig. 8 illustrates the content of area 302 (Fig. 7) of RAM 206 (Fig. 
2). Area 302 includes two types of data, i.e., the data representing the angle 
of joint JT (Fig. 4) produced by upper arm UA (Fig. 4) and lower arm LA (Fig. 
4), and the data representing the amount of wrinkles displayed. In the 
example described in Fig. 8, the amount of wrinkles displayed is 0 when the 
angle of joint JT produced by upper arm UA and lower arm LA is 180 degrees. 
However, the amount of t h e w rjfvktes- wrinkles increases as the angle of joint 
JT produced by upper arm UA and lower arm LA decreases. In the present 
example, the amount of wrinkle displayed is 1 when the angle is - l ess -t han-l&Q 
degree s and 160 degree s or m ore at least 160 degrees or more, but less than 
180 degrees ; the amount of wrinkles displayed is 2 when the angle is l ess 



21 



t - han - 4€G -- € te gre ^ at jeast 135 degrees or more, but 

less than 180 degrees ; the amount of wrinkles displayed is 3 when the angle 

more, but less than 135 degrees ; and the amount of wrinkles displayed is 4 

degrees or _m 

[0098] Fig. 9a through Fig. 9e illustrate how arm AR is displayed on 
monitor 201 (Fig. 2) in accordance with the data stored in area 302 (Fig. 7) of 
RAM 206 (Fig. 2). Assuming that arm AR is covered with fabric FB. When arm 
AR is stretched as described in Fig. 9a and the angle of joint JT (Fig. 4) 
produced by lower arm LA and upper arm UA is 180 degrees, no wrinkles are 
shown on or near joint JT. As described in Fig. 9b, when arm AR is slightly 
bent and the angle of joint JT produced by lower arm LA and upper arm UA is 
l e ss -- t - hen - 4BQ - 4 e gr ee s -- aBd - 4€Q - d e gr ee s er -- mer e- at least 180 degrees or more, 
but less than 180 degrees, one wrinkle, i.e., wrinkle 401 is displayed on or 
near joint JT. As described in Fig. 9c, when arm AR is further bent and the 
angle of joint JT produced by lower arm LA and upper arm UA is l ess th a n 

tharv|^0_degrees , two wrinkles, i.e., wrinkles 401 and 402 are displayed on or 
near joint JT. As described in Fig. 9d, when the angle of joint JT produced by 
lower arm LA and upper arm UA is less than 135 degrees and 110 degrees or 
fBOfe at least 110 degrees or more, but less than 1 35 degrees , three wrinkles, 
i.e., wrinkles 401 , 402, and 403 are displayed on or near joint JT. As 
described in Fig. 9e, when the angle of joint JT produced by lower arm LA and 
upper arm UA is le ss - tfoare A 4Q d e gr ee s - and - 2 - fi d e gr ee s or - mere at least 20 
degrees or more, but less than 110 degrees , four wrinkles, i.e., wrinkles 401 , 
402, 4Q3-aBd-4Q4 403 i _and_4^4 L are displayed on or near joint JT. 

[0099] Fig. 10 illustrates a plurality of texture utilized to display wrinkles 
on monitor 201 (Fig. 2). As illustrated in Fig. 10, RAM 206 (Fig. 2) includes 
area 303. Area 303 stores a plurality of textures which are pasted on polygons, 
i.e., textures Tx 506, Tx 507, Tx 508, and Tx 509. Tx 506 includes one wrinkle, 
i.e., wrinkle 401 illustrated in Fig. 9b; Tx 507 includes two wrinkles, i.e., 
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wrinkles 401 and 402 illustrated in Fig. 9c; Tx 508 includes three wrinkles, i.e., 
wrinkles 401 , 402, and 403 illustrated in Fig. 9d; and Tx 509 includes four 
wrinkles, i.e., wrinkles 401, 402, 403, and 404 illustrated in Fig. 9e. 

[0100] Fig. 1 1 illustrates the operation of the wrinkle generating software 
stored in area 301 (Fig. 3) of RAM 206 (Fig. 2). First of all, CPU 21 1 (Fig. 2) 
calculates the angle of joint JT produced by lower arm LA and upper arm UA. 
If the angle is 180 degrees (S1a), CPU 211 does not access area 303 (Fig. 
1 0) of RAM 206 (S2a). If the angle is l ess th a n 1 8 0 d e gr ees a nd 16 0 d e gr ees 

21 1 retrieves Tx 506 from area 303 of RAM 206 (S2b). In the same manner, if 
the angle is less4^a-B-4-SQ-deefees and 1-35 d e gr ees of mor e at least 135 
degrees or more, but less than 160 degrees (S1c), CPU 21 1 retrieves Tx 507 
from area 303 of RAM 206 (S2c); if the angle is tess-4han -4-3& 4e§^ees--a^d 
4 - 1 - 0 - d e gr ee s - ef -- mor -e-- at least 110 degrees or more, but less than 135 degrees 
(S1d), CPU 21 1 retrieves Tx 508 from area 303 of RAM 206 (S2d); and if the 
angle is ie ss -- t - haR - 4 1 - 0 - 4 e gre e s -- a^^ ieast 2 0 degrees or 

more, but less than 110 degrees (S1 e), CPU 21 1 retrieves Tx 509 from area 
303 of RAM 206 (S2e). 

[0101] Instead of pasting textures to polygons in order to display wrinkles, 
a plurality of polygons may be used to produce wrinkles as described in Fig. 
12a through Fig. 12d. One wrinkle can be produced by one set of two 
polygons, i.e., P7 and P8 as described in Fig. 12a. Two wrinkles can be 
produced by two sets of two polygons, i.e., P7 and P8, and P9 and P10 as 
described in Fig. 12b. Three wrinkles can be produced by three sets of two 
polygons, i.e., P7 and P8, P9 and P10, and P11 and P1 2 as described in Fig. 
12c. Four wrinkles can be produced by four sets of two polygons, i.e., P7 and 
P8, P9 and P10, P11 and P12, and P13 and P14 as described in Fig. 12d. 
The operation of the wrinkle generating software stored in area 301 (Fig. 3) of 
RAM 206 (Fig. 2) in this embodiment is similar to the one described in Fig. 1 1 . 
Such operation is not shown in the drawings. First of all, CPU 21 1 (Fig. 2) 
calculates the angle of joint JT produced by lower arm LA and upper arm UA. 
If the angle is 180 d e gr ees CPU 21 1 degrees, CPU 21 1 does not produce any 
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wrinkles by polygons. If the angle is- le ss - than 4&Q - d e gr ee s - and - 4%Q - d e gr ee s 
er - mofe at least 180 degrees or more, but !ess than 180 degrees , CPU 21 1 
produces polygons P7 and P8 to display one wrinkle as illustrated in Fig. 12a. 
In the same manner, if the angle is less than 160 de grees and 135 degrees or 
mere at least 135 degrees or more, but less than 160 degrees, CPU 21 1 
produces polygons P7, P8, P9, and P10 to display two wrinkles as illustrated 
in Fig. 12b; if the angle is- 4ess - t ^ af > -- 1 - 35 - degfees and - - 1 - 4 Q - degfees - er - mofe jgt 
least 110 degrees or more, but less than 135 degrees , CPU 21 1 produces 
polygons P7, P8, P9, P1 0, P1 1 , and P1 2 to display three wrinkles as 
illustrated in Fig. 12c; and if the angle is jess than 410 degrees af*d-2Q 
degrees or more atjeast 2.0 ^ CPU 
211 produces polygons P7, P8, P9, P10, P11, P12, P13, and P14 to display 
four wrinkles as illustrated in Fig. 12d. 

[0102] Fig. 13 through Fig. 18d illustrate the method of determining the 
height of the wrinkles that should be displayed on monitor 201 (Fig. 2). 

[0103] As illustrated in Fig. 13, RAM 206 (Fig. 2) includes area 304. Area 
304 stores a plurality of data which are necessary to determine the height of 
the wrinkles. 

[0104] Fig. 14 illustrates the content of area 304 (Fig. 13) of RAM 206 
(Fig. 2). As illustrated in Fig. 14, area 304 includes two types of data, i.e., the 
data representing the angle of joint JT (Fig. 4) produced by upper arm UA (Fig. 
4) and lower arm LA (Fig. 4), and the data representing the height of wrinkles 
displayed. For example, the height of the wrinkle displayed is 0 when the 
angle of joint JT produced by upper arm UA and lower arm LA is 180 degrees. 
However, the height of the wrinkle increases as the angle of joint JT produced 
by upper arm UA and lower arm LA decreases. In the example explained in 
Fig. 14, the height of the wrinkle displayed is 1 when the angle is4ess than 
4 - 80 - d e gf ee- s -- aRd -- 1 - 6Q - d e gf ee s -- er --i TOr e at least 160 degrees or more, but less 
than 180 degrees ; the height of the wrinkle displayed is 2 when the angle is 
less th a n 160 deg r ee s and 135 degree s or more at least 135 degrees or more, 
but less than 160 degrees ; the height of the wrinkle displayed is 3 when the 
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angle is 4 a ss - t j w^4 - 3# - d ^ at least 1 10 degrees 

or more, but less than 135 degrees ; and the height of the wrinkle displayed is 

4 when the angle i s4ess4frafi-44Q-aeci rees and-aQ-deefees^-or mor e at least 20 
degrees or more, but less than 110 degrees . 

[0105] Fig. 15a through Fig. 15e illustrate how arm AR is displayed on 
monitor 201 (Fig. 2) in accordance with the data stored in area 304 (Fig. 14) of 
RAM 206 (Fig. 13). Assuming that arm AR is covered with fabric FB. When 
arm AR is stretched as described in Fig. 15a and the angle of joint JT 
produced by lower arm LA and upper arm UA is 180 degrees, no wrinkles are 
shown on or near joint JT. As illustrated in Fig. 15b, when arm AR is slightly 
bent and the angle of joint JT produced by lower arm LA and upper arm UA is 
less than 180 degrees and 180 degrees or more at least 180 degrees or more, 
but jess than 180 degrees , a small wrinkle, i.e., wrinkle 410 is displayed on 
monitor 201 . As illustrated in Fig. 15c, when arm AR is further bent and the 
angle of joint JT produced by lower arm LA and upper arm UA is--l ess -- t - ha - R 
1 - 8Q - €i e gf ee s -- and - 43 - 5 - d at least 135 degrees or mo re, but less 

than 180 degrees , a wrinkle larger than the one described in Fig. 15b is 
displayed on monitor 201 . As illustrated in Fig. 15d, when the angle of joint JT 
produced by lower arm LA and upper arm UA is less than 135 degrees and 
44#-degfee^-er-FRefe at least 110 degrees or more, but less than 135 degrees , 
a wrinkle larger than the one described in Fig. 1 5c is displayed on monitor 201 . 
As illustrated in Fig. 15e, when the angle of joint JT produced by lower arm LA 
and upper arm UA is less than 110 degrees and 20 degree s or more at least 
20 degrees or more, but less than 110 degrees , a wrinkle larger than the one 
described in Fig. 15d is displayed on monitor 201. 

[0106] Fig. 16 illustrates a plurality of textures utilized to display wrinkles 
on monitor 201 (Fig. 2). As illustrated in Fig. 16, RAM 206 (Fig. 2) includes 
area 305. Area 305 stores a plurality of textures which are pasted on polygons, 
i.e., textures Tx 510, Tx 51 1 , Tx 512, and Tx 513. Tx 510 includes an -i mag e 
the image of wrinkle 410 illustrated in Fig. 15b; Tx 511 includes afnmaf e -the 
image of a larger wrinkle 410 illustrated in Fig. 15c; Tx 512 includes a n im a ge 
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the image of wrinkle 410 illustrated in Fig. 15d; and Tx 513 includes a - n - i fnag e 
the image of wrinkle 410 illustrated in Fig. 15e. 

[0107] Fig. 17 illustrates the operation of wrinkle generating software 
stored in area 301 (Fig. 3) of RAM 206 (Fig. 2). First of all, CPU 21 1 (Fig. 2) 
calculates the angle of joint JT produced by lower arm LA and upper arm UA. 
If the angle is 180 degrees (S1a), CPU 211 does not access area 305 (Fig. 
1 6) of RAM 206 (Fig. 2) (S2a). If the angle is loss th a n 180 degrees a nd 160 
d eg r ees or mor e at ieast 160 degrees or more, but less than 180 degrees 
(S1b), CPU 21 1 retrieves Tx 510 from area 305 (Fig. 16) of RAM 206 (S2b). 
In the same manner, if the angle is iess than 160 degrees and 135 degrees or 
mefe- at least 135 degrees or more, but less than 160 degrees (S1c), CPU 
21 1 retrieves Tx 51 1 from area 305 of RAM 206 (S2c); if the angle is less than 

than 135 degrees (S1d), CPU 21 1 retrieves Tx 512 from area 305 of RAM 206 
(S2d); and if the angle is less -- tfoaa --- 1 - 4 - Q -- degfe^ 

least 20 degrees or more, but less tha n 110 degrees, (S1e), CPU 211 
retrieves Tx 513 from area 305 of RAM 206 (S2e). 

[01 08] Instead of pasting textures to polygons in order to display wrinkles, 
a plurality of polygons may be used to produce wrinkles as described in Fig. 
18a through Fig. 18e. Assuming that arm AR is covered with fabric FB. When 
arm AR is stretched as described in Fig. 18a and the angle of joint JT 
produced by lower arm LA and upper arm UA is 180 degrees, no wrinkles are 
shown on or near joint JT. As illustrated in Fig. 18b, a small wrinkle 410 can 
be produced by two small polygons, i.e., P16 and P17. As illustrated in Fig. 
18c, a tef§-ef-wrinkle 410 larger than the one described in Fig. 18b can be 
produced by the same set of polygons, i.e., P16 and P17 by stretching them 
vertically. As illustrated in Fig. 18d, a larger wrinkle 410 larger than the one 
described in Fig. 18c can be produced by the same set of polygons, i.e., P16 
and P17 by further stretching them vertically. As illustrated in Fig. 18e, a 
tefg^-wrinkle 410 larger than the one described in Fig. 18d can be produced 
by the same set of polygons, i.e., P16 and P17 by even more stretching them 
vertically. The operation of the wrinkle generating software in this embodiment 
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is similar to the one described in Fig. 1 1 . Such operation is not shown in the 
drawings. First of all, CPU 21 1 (Fig. 2) calculates the angle of joint JT 
produced by lower arm LA and upper arm UA. If the angle is 180 degrees, 
CPU 21 1 does not produce any wrinkles with polygons. If the angle is4ess 

jess than 180 degrees, CPU 21 1 produces a small set of polygons P16 and 
P17 to display one wrinkle, wrinkle 410, as illustrated in Fig. 18b. In the same 

manner, if the angle is le ss t han 180 d egree s and 1 35 degrees or more at 

least 135 degrees or more, but less than 180 degrees , CPU 21 1 stretches 
polygons P16 and P17 vertically and makes wrinkle 410 as illustrated in Fig. 
18c; if the angle is less than 135 degrees and 110 degrees or more _at_least 
110 degrees or more, but less than 135 degrees , CPU 21 1 further stretches 
polygons P16 and P17 vertically and make wrinkle 410 as illustrated in Fig. 
18d; and if the angle is-4ess-#w^ 

20 degrees or more, but less than 110 degrees , CPU 21 1 even more 
stretches polygons P1 6 and P1 7 vertically and make wrinkle 410 as illustrated 
in Fig. 18e. 

[0109] Fig. 19 through Fig. 24e illustrate the method of determining the 
amount and the height of wrinkles that should be displayed on monitor 201 
(Fig. 2). 

[0110] As illustrated in Fig. 19, RAM 206 (Fig. 2) includes area 306. Area 
306 stores a plurality of data which are necessary to determine the amount 
and the height of the wrinkles. 

[011 1] Fig. 20 illustrates the content of area 306 (Fig. 19) of RAM 206 
(Fig. 2). As illustrated in Fig. 20, area 306 includes three types of data, i.e., 
the data representing the angle of joint JT (Fig. 4) produced by upper arm UA 
(Fig. 4) and lower arm LA (Fig. 4), the data representing the amount of 
wrinkles displayed, and the data representing the height of wrinkles displayed. 
For example, the amount and the height of wrinkle displayed is 0 when the 
angle of joint JT produced by upper arm UA and lower arm LA is 180 degrees. 
However, the amount of the wrinkle displayed is 1 and the height of the 
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wrinkle displayed is 1 when the angle is-j-e s - s4han - 4 - 80 - d e §r ee s -- af > d -- 4 - 60 
dec i Fees - ef - fnere at least 160 degrees or more, but less than 180 degrees ; the 
amount of the wrinkle displayed is 1 and the height of wrinkle displayed is 2 
when the angle is less th a n 160 d e grees and 135 degrees or more at least 
135 degrees or more, but less than 160 degrees; the amount of the wrinkles 
displayed is 3 and the height of the wrinkles displayed is 1 , 2, and 1 
respectively when the angle is 4es - s - th - an -- 43 - ^ 

mor e at least 110 degrees or more, but less than 1 35 degrees ; and the 
amount of the wrinkles displayed is 5 and the height of the wrinkles displayed 
is 1 , 2, 3, 2, and 1 respectively when the angle is-ias s -tfo o n 110 degfeas-and 
20 degrees or more _at_least .20 degrees or m 

[01 1 2] Fig. 21 a through Fig. 21 e illustrate how arm AR is displayed on 
monitor 201 (Fig. 2) in accordance with the data stored in area 306 (Fig. 19) of 
RAM 206 (Fig. 2). Assuming that arm AR is covered with fabric FB. When arm 
AR is stretched as described in Fig. 21a and the angle of joint JT produced by 
lower arm LA and upper arm UA is 180 degrees, no wrinkles are shown on or 
near joint JT. As illustrated in Fig. 21b, when arm AR is slightly bent and the 
angle of joint JT produced by lower arm LA and upper arm UA is4ees*af> 
180 degrees and 160 degrees or more ..at j_east..M 

than 180 degrees , a small wrinkle, i.e., wrinkle 41 1 is displayed on monitor 
201 . As illustrated in Fig. 21c, when arm AR is further bent and the angle of 
joint JT produced by lower arm LA and upper arm UA is l ess th a n 160 
degrees and 135 degree s or more at least 135 degrees or more, but less than 
160 degrees , wrinkle 41 1 which is larger than the one described in Fig. 21 b is 
displayed on monitor 201 . As illustrated in Fig. 21 d, when the angle of joint JT 
produced by lower arm LA and upper arm UA is less than 135 degrees and 



wrinkle 411 as large as the one described in Fig. 21c is displayed on monitor 
201 and two small wrinkles, i.e., wrinkles 412 and 413 appear ef>4ef^an4-f4§-h 




s4des- on the left and right sides of wrinkle 41 1 respectively. As illustrated in 
Fig. 21 e, when the angle of joint JT produced by lower arm LA and upper arm 

UA is le ss th a n 110 degree s and 2 0 degrees or more at least 20 degrees or 
more, but less than 110 degrees , wrinkle 41 1 larger than the one described in 




at [east 110 degrees or to 
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Fig. 21 d is displayed on monitor 201 and wrinkles 412 and 413 as large as the 
one described in Fig. 21c appear on both sides of wrinkle 411 respectively, 
and in addition small wrinkles 414 and 420 appear adjacent to wrinkles 412 
and 413 respectively. 

[0113] Fig. 22 illustrates a plurality of textures utilized to display wrinkles 
on monitor 201 (Fig. 2). As illustrated in Fig. 22, RAM 206 (Fig. 2) includes 
area 307. Area 307 stores a plurality of textures which are pasted on polygons, 
i.e., textures Tx 515, Tx 516, Tx 517, and Tx 518. Tx 515 includes the image 
of wrinkle 41 1 illustrated in Fig. 21b; Tx 516 includes the image of wrinkle 41 1 
illustrated in Fig. 21c; Tx 517 includes the image of wrinkles 41 1 , 412, and 
413 illustrated in Fig. 21d; and Tx 518 includes the image of wrinkles 41 1 , 412, 
413, 414, and 420 illustrated in Fig. 21e. 

[01 14] Fig. 23 illustrates the operation of wrinkle generating software 
stored in area 301 (Fig. 3) of RAM 206 (Fig. 2). First of all, CPU 21 1 (Fig. 2) 
calculates the angle of joint JT produced by lower arm LA and upper arm UA. 
If the angle is 180 degrees (S1a), CPU 211 does not access area 307 (Fig. 
22) of RAM 206 (S2a). If the angle is tess*aR^ 

or more ajMea^^ 1b), CPU 

21 1 retrieves Tx 515 from area 307 of RAM 206 (S2b). In the same manner, if 
the angle is less than 160 degrees and 135 degrees or more at least 135 
degrees or more, but less than 160 degrees (S1 c), CPU 21 1 retrieves Tx 51 6 
from area 307 of RAM 206 (S2c); if the angle is less than 135 degrees and 
140 £le€jfees -- er - mere - at least 110 degrees or more, but iess than 135 degrees 
(S1d), CPU 21 1 retrieves Tx 517 from area 307 of RAM 206 (S2d); and if the 
angle is less than 110 degrees and 20 degrees or more at least 20 degrees or 
more, but e), CPU 21 1 retrieves Tx 51 8 from area 

307 of RAM 206 (S2e). 

[01 1 5] Instead of pasting textures to polygons in order to display wrinkles, 
a plurality of polygons may be used to produce wrinkles as described in Fig. 
24a through Fig. 24e. Assuming that arm AR is covered with fabric FB. When 
arm AR is stretched as described in Fig. 24a and the angle of joint JT 
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produced by lower arm LA and upper arm UA is 180 degrees, no wrinkles are 
shown on or near joint JT. As illustrated in Fig. 24b, when arm AR is slightly 
bent and the angle of joint JT produced by lower arm LA and upper arm UA is 
less than 180 degr e es and 160 degrees or more at least 160 degrees or more, 
but less Jharij_8gLdegrees 1 a small wrinkle, i.e., wrinkle 41 1 is displayed on 
monitor 201 by a set of two polygons P16 and P17. As illustrated in Fig. 24c, 
when arm AR is further bent and the angle of joint JT produced by lower arm 
LA and upper arm UA is l e ss than 1 60 degree s and - 1 - 35 d e gr ee s er mor e at 
least 135 degrees or more, but less than 160 degrees , wrinkle 41 1 which is 
larger than the one described in Fig. 24b is displayed on monitor 201 by 
stretching the set of two polygons P16 and P17 vertically. As illustrated in Fig. 
24d, when the angle of joint JT produced by lower arm LA and upper arm UA 
is less than 135 degrees and 110 degrees or more at least 110 degrees or 
more, buy wrinkle 41 1 as large as the one described in 

Fig. 24c is displayed on monitor 201 by the set of polygons P1 6 and P1 7 and 
two small wrinkles, i.e., wrinkles 412 and 413 appear eB4e - f t-- and -- r -i gh t-- s i des --on 
the left and right sides of wrinkle 41 1 respectively. Wrinkle 412 is produced by 
the set of polygons P1 8 and P 1 9, and wrinkle 413 is produced by the set of 
polygons P20 and P21. As illustrated in Fig. 21 e, when the angle of joint JT 
produced by lower arm LA and upper arm UA is less than 1 1 0 degrees and 20 
degfees--ef-meg ; e at least 20 degrees or more, but l ess than 110 degrees , 
wrinkle 41 1 larger than the one described in Fig. 21 d is displayed on monitor 
201 by further stretching the set of polygons P16 and P17 vertically and 
wrinkles 412 and 413 as large as wrinkle 41 1 in Fig. 21 d appear on both sides 
of wrinkle 41 1 respectively. Here, wrinkles 412 and 41 3 are produced by the 
sets of P18 and P 19, and P20 and P21 respectively, and they are stretched 
to increase the height thereof . Additional wrinkles 414 and 420 appear 
adjacent to wrinkles 412 and 413 respectively where wf-mk\^--wr\nkie^^4 and 
420 are produced by the sets of P22 and P23, and P24 and P25 respectively. 
The operation of the wrinkle generating software in this embodiment is similar 
to the one described in Fig. 1 1 . Such operation is not shown in the drawings. 
First of all, CPU 21 1 (Fig. 2) calculates the angle of joint JT produced by lower 
arm LA and upper arm UA. If the angle is 1 80 degrees, CPU 21 1 does not 
produce any wrinkles with polygons. If the angle is l ess th a n 1 8 0 d e gr ees a nd 



30 



46Q - aear ee s - of - mor e at least 180 degrees or more, but iess than 180 degrees , 
CPU 21 1 produces a small set of polygons P16 and P17 to display wrinkle 
41 1 as illustrated in Fig. 24b. In the same manner, if the angle is4ess4han-4€Q 
degrees and 135 degrees or more at least 135 degrees or more, but less than 
160 degrees . CPU 21 1 stretches fee- po l ygons polygons P1 6 and P17 
vertically and make wrinkle 41 1 as illustrated in Fig. 24c; if the angle is less 
tfaaR -- 1 - (M - €Segm at least 110 degrees or more, but 

less than 135 degrees , CPU 21 1 stretches th e p ol ygo n s polygons P1 6 and 
P1 7 vertically and make wrinkle 41 1 as illustrated in Fig. 24d and add two 
small wrinkles, i.e., wrinkle 412 and 413 by producing P18 and P19, and P20 
and P21 respectively; and if the angle is less than 110 degrees and 20 
de€H=ees-ef-mef=e at least 20 degrees or more, but less than 110 degrees , CPU 
21 1 further stretches the polygons polygons P16 and P17 vertically and make 
wrinkle 41 1 as illustrated in Fig. 24e. CPU 21 1 increases the height of 
wrinkles 412 and 413 by stretching the two sets of polygons P18 and P19, 
and P20 and P21 respectively. In addition, CPU 21 1 adds two small wrinkles 
414 and 420 adjacent to wrinkles 412 and 413 respectively by producing two 
sets of polygons P22 and P23, and P24 and P25 respectively. 

[0116] Fig. 25 through Fig. 32e illustrate the method of determining the 
muscle movement of upper arm UA. 

[0117] Fig. 25 illustrates the content of area 308 of RAM 206 (Fig. 2). 
Area 308 stores the muscle movement generating software which administers 
the muscle movement of upper arm UA as described in details hereinafter. 

[01 1 8] Fig. 26 illustrates the concept of the present invention. As 
described in Fig. 26, arm AR of an object (frumaFi-beim a human being ) is 
composed of hand HD, lower arm LA, joint JT, and upper arm UA. When arm 
AR is bent, muscle M bulges and thereby increases the thickness of upper 
arm UA. 

[01 1 9] Fig. 27 illustrates the method of generating the muscle movement. 
The most convenient way to generate the muscle movement is to have the 
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muscle M eempes e d - w i tfo - composed of a plurality of polygons. In the example 
described in Fig. 27, muscle M is composed of polygons P42, P43, P44, and 
P45. Polygons P46 and P47 are part of upper arm UA, but not part of muscle 
M. 

[0120] As illustrated in Fig. 28, RAM 206 (Fig. 2) includes area 309. Area 
309 stores a plurality of data which are necessary to produce the muscle 
movement of upper arm UA. 

[0121] Fig. 29 illustrates the content of area 309 (Fig. 28) of RAM 206. 
Area 309 includes two types of data, i.e., the data representing the angle of 
joint JT (Fig. 26) produced by upper arm UA (Fig. 26) and lower arm LA (Fig. 
26), and the data representing the property of the muscle movement. The 
more tfre-vafae-9f4^ value of mus cle pro perty increases 

the more the thickness of upper arm UA increases. For example, the value of 
the -- mu - s€ -[ e - f)reDer - t - v -- the value of muscle property is 0 when the angle of joint 
JT produced by upper arm UA and lower arm LA is 180 degrees. The value of 
the muscle property increases as the angle of joint JT produced by upper arm 
UA and lower arm LA decreases. In the present example described in Fig. 29, 
the value of the muscle property the 1 when the 

or more, but less than 1 80 degrees ; the value of the muscle property the value 
of muscle property is 2 when the angle is l ess th a n 160 d e gr ees a nd 135 
degree s or more at least 135 degrees or more, but less than 160 degrees ; tne 
v - atoe - ef4h - e -- mus€ -[ e - 0roeef - tv -- the value of muscle property is 3 when the angle 
is--ie ss -- t - ha - R - 4 - 35 -- d ^ at least 110 degrees or 

more, but less than 135 degrees; and the value of the muscle property the 
yajuejgljn^ 4 when the angle is4ess--tlw^ 

degrees or more at least 20 degrees or more, but less than 110 degrees . 

[0122] Fig. 30a through Fig. 30e illustrate how arm AR is displayed on 
monitor 201 (Fig. 2) in accordance with the data stored in area 309 (Fig. 28) of 
RAM 206 (Fig. 2). When arm AR is stretched as described in Fig. 30a and the 
angle of joint JT produced by lower arm LA and upper arm UA is 180 degrees, 
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no muscle movement appears on upper arm UA. As described in Fig. 30b, 
when arm AR is slightly bent and the angle of joint JT produced by lower arm 

least 160 d egrees or more, but less than 180 degrees , the muscle movement 
occurs and muscle M bulges. As described in Fig. 30c, when arm AR is 
further bent and the angle of joint JT produced by lower arm LA and upper 
arm UA is 4ess - tfeaf^4SQ - degre at least 135 

degrees or more, but less than 180 degrees , muscle M bulges more 
compared to the one shown in Fig. 30b. As described in Fig. 30d, when the 
angle of joint JT produced by lower arm LA and upper arm UA is4es-s--tfr-an 
135 degrees and 110 degrees or mef ejajj^ 

than 135 degrees , muscle M bulges more compared to the one shown in Fig. 
30c. As described in Fig. 30e, when the angle of joint JT produced by lower 
arm LA and upper arm UA is-4ess-4ha^ 

at least 20 degrees or more, but less than 110 degrees , muscle M bulges 
more compared to the one shown in Fig. 30d. 

[0123] Fig. 31 illustrates the operation of the muscle movement 
generating software stored in area 308 (Fig. 25) of RAM 206 (Fig. 2). First of 
all, CPU 21 1 (Fig. 2) calculates the angle of joint JT produced by lower arm 
LA and upper arm UA. If the angle is 1 80 degrees (S1 a), CPU 21 1 retrieves 
the muscle property data from area 309 (Fig. 29) of RAM 206 (Fig. 2). Since 
the muscle property is 0, no muscle movement occurs and upper arm UA 
described in Fig. 30a is shown (S2a). If the angle is le s s th a n 180 degrees 
and - 1 §Q - deafees - er - mofe at least 160 degrees or more, but less than 180 
degrees (S1b), CPU 211 retrieves the muscle property which is 1 and upper 
arm UA described in Fig. 30b is shown (S2b). In the same manner, if the 

or more, but less than 160 degrees (Sic), CPU 21 1 retrieves the muscle 
property which is 2 and upper arm UA described in Fig. 30c is shown (S2c); if 
the angle is ie ss -- t j w^4 - 35 -- d e gf ee- ^ least 110 

degrees or more, but less than 135 degrees (S1d), CPU 21 1 retrieves the 
muscle property which is 3 and upper arm UA described in Fig. 30d is shown 
(S2d); and if the angle is l ess th a n 110 d e gr ees a nd 20 d e gr ees or mor e at 
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least 20 degrees or more, but less than 1 10 degrees (S1e), CPU 21 1 retrieves 
the muscle property which is 4 and upper arm UA described in Fig. 30e is 
shown (S2e). 

[0124] Fig. 32a through Fig. 32e illustrate how the polygons are utilized in 
displaying the muscle movement. 

[0125] As illustrated in Fig. 32a, when arm AR is stretched and the angle 
of joint JT produced by lower arm LA and upper arm UA is 180 degrees, no 
muscle movement appears on upper arm UA and the polygons consisting of 
muscle M, i.e., P27, P28, and P29 remains in a straight line or almost in a 
straight line. Polygons P26 and P30 are part of upper arm UA, however, does 
not compose muscle M. As described in Fig. 32b, when arm AR is slightly 
bent and the angle of joint JT produced by lower arm LA and upper arm UA is 
l e ss -- t - hen - 4BQ - 4 e gr ee s -- aBd - 4€Q - d e gr ee s er - mor -e at least 180 degrees or more, 
but less than 180 degrees , the muscle movement occurs and muscle M 
composed of polygons P27, P 2 8 and P 2 9 P28, and P29 bulges. As described 
in Fig. 32c, when arm AR is further bent and the angle of joint JT produced by 
lower arm LA and upper arm UA is-4ess--ywM-^ 

fm m.M_j_east_l.35 muscle M 

composed of polygons P27, P-28-an4 -P-20- P28 . and P29 bulges more 
compared to the one shown in Fig. 32b. As described in Fig. 32d, when the 
angle of joint JT produced by lower arm LA and upper arm UA is l ess th a n 
135 degree s and 110 degree s or more at least 110 degrees or more, but less 
than 135 degrees , muscle M composed of polygons P27, P2& - ar \ d-P2&- P28 Ji 
and P29 bulges more compared to the one shown in Fig. 32c. As described in 
Fig. 32e, when the angle of joint JT produced by lower arm LA and upper arm 

more, but less than 1 1 0 degrees , muscle M bulges more compared to the one 
shown in Fig. 32d. Here, muscle M is composed of polygons P27, P-2-S~aR# 
P2Q P28, and P29 , and new polygons P31 and P32 are inserted between P27 
and P28, and P28 and P29, respectively. 
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[0126] Having thus described a presently preferred embodiment of the 
present invention, it will not be appreciated that the aspects of the invention 
have been fully achieved, and it will be understood by those skilled in the art 
that many changes in construction and circuitry and widely differing 
embodiments and applications of the invention will suggest themselves 
without departing from the spirit and scope of the present invention. The 
disclosures and the description herein are intended to be illustrative and are 
not in any sense limiting of the invention, more preferably defined in scope by 
the following claims. 



35 



